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The band-gap problem and other systematic failures of approximate functionals are explained 
from an analysis of total energy for fractional charges. The deviation from the correct intrinsic linear 
behavior in finite systems leads to derealization and localization errors in large or bulk systems. 
Functionals whose energy is convex for fractional charges such as LDA display an incorrect apparent 
linearity in the bulk limit, due to the derealization error. Concave functionals also have an incorrect 
apparent linearity in the bulk calculation, due to the localization error and imposed symmetry. This 
resolves an important paradox and opens the possibility to obtain accurate band-gaps from DFT. 
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Accurate band-gap prediction is critical for applica- 
tions in condensed matter and nanotechnology. This un- 
fortunately is not currently possible within the widely 
used density functional theory (DFT). The basic theory 
of the band-gap in DFT has been addressed [TJ [2] but 
confusion remains. In our recent work [3], it is shown 
possible to obtain the correct band-gap from DFT calcu- 
lations and demonstrate the theory for finite systems. 

The main challenge is in the approximate exchange- 
correlation functionals [H EJ |6j |7], which, despite the 
success in a wide range of applications, still suffer from 
systematic problems in describing charge-transfer pro- 
cesses, excitation energies in molecules, response prop- 
erties in solids, electron transport and the band-gaps of 
semiconductors. Previous understanding has focused on 
self-interaction-error and the nature of the Kohn-Sham 
(KS) eigenvalues but recent work j3j |8j |9j [10] has related 
these problems, more usefully, to the incorrect descrip- 
tion of systems with fractional charges. 

In this Letter, we will resolve a paradox on the appar- 
ent linearity of E(N) for bulk systems for any approxi- 
mate functionals and provide insight on the physical basis 
underlying the systematic errors of functionals in large or 
extended systems, and its implication in the calculation 
of the band-gap and other properties. 

The fundamental gap of an iV-electron semiconductor 
can be written as energy differences from integer points 

4£p ger = {E(N - 1) - E(N)} - {E(N) - E(N + 1)\ 
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or as a difference of derivatives at N 
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where E^ geT = E^" v only if the total energy is a 
straight line between the integers, which is the case for 
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the exact functional as shown by Perdew et. al. based 
on grand canonical ensembles [11] and later by Yang et. 
al. based on pure states [12] . 

There has been some question as to how the derivatives 
on the right hand side of Eq. [2]are evaluated. In the case 
where E xc is an explicit functional of p, such as LDA or 
GGA, then 



e: 



gap 



gap 



(3) 



and -Egap lv is just obtained from the KS eigenvalues. 
The detailed expressions of §^\ N±S for other forms of 
exchange-correlation functionals have been derived re- 
cently [3J. When E xc has an explicit dependence on the 
occupied KS orbitals, E xc [<j>i\, then [5] 
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Thus, for such an orbital functional, the KS eigenval- 
ues from an optimized effective potential (OEP) [T3] cal- 
culation are no longer the derivative of the energy ex- 
pression. However, the derivatives can be exactly the 
eigenvalues in a generalized Kohn-Sham (GKS) calcula- 
tion (e.g. Hartree-Fock calculations in the case of exact 
exchange) [3]: 
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We see that the second term on the right hand side of Eq. 
[3J which is labeled the derivative discontinuity A xc [TJH], 
is essentially the difference between an OEP and GKS 
calculation. However, it does not contain the physics of 
the error of the band-gap, as can clearly be seen from a 
consideration of the LDA or GGA band-gap. 

The error in the band-gap calculation using approxi- 
mate functionals is in the following 
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Figure 1: Energy vs Number of electron curve for a finite sys- 
tem with three hypothetical functionals with: exact straight 
line behavior, <57V-convex behavior and <5iV-concave behavior 
all which gave the same 7 and A. 



where 
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Here A s t ra i g ht, the difference between the gap from fi- 
nite difference and the derivatives, accounts for the fact 
that an approximate functional may not have the cor- 
rect straight line behavior between the integers. It is the 
consideration of this term, completely missing in the lit- 
erature, that is the key in understanding the band-gap. 
We have seen that A stra ight has an important effect in 
the energy gap in molecules [3] . The focus of this Letter 
is to explore its implications for extended systems. 

Now we present an important paradox for considera- 
tion of periodic or bulk systems: It has been argued in 
extended systems that the behavior of the total energy as 
a function of addition of an electron must be a straight 
line [UH], therefore A stra ; g ht = for all functionals. How 
can it be opposite to the case of the finite systems [31 [5]? 
Furthermore, for LDA, A xc — 0, meaning that A = 0. 
What is then the origin of the systematic error for LDA ? 
It is well known [TJ] that the calculation of semiconduc- 
tors and wide gap insulators with a semi-local functional 
(such as LDA) has large systematic errors, underpredict- 
ing the band-gap by up to several eV. 

We will resolve this apparent paradox by understand- 
ing more about the straight line behavior of energy func- 
tionals in solids. 

The simplest periodic system to consider is a molecular 
crystal in the infinite lattice constant limit. We start with 
a monomer unit whose E(N) curve for different func- 
tionals is as in Fig. [TJ the exact functional with correct 
straight line behavior, one with incorrect convex behavior 
for fractional charges (<5iV-convex) such as LDA, and an- 
other with incorrect concave behavior (5 TV-concave) such 



Figure 2: The same as Figure [T] except taken to the bulk 
limit. An additional curve is shown where crystal symmetry 
is imposed on a (W-concave functional calculation. 



as HF theory. Next consider adding an electron to more 
than one monomer unit. If we first take the case of two 
monomer units, then we can see that adding an electron 
to a (5iV-convex functional leads to half an electron on 
each unit, as it is much lower than the energy of two 
monomers, with N and N+1 electrons respectively. It is 
clear to sec in this manner that with M monomer units 

ME(N + — ) < (M — l)E(N) + E(N + 1). (9) 

As the number of units M — > oo, the added S elec- 
tron delocalizes on to all the units such that the energy 
approaches the initial slope of the r5iV-convex monomer 
curve as in Figure 2: 
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In this way a functional like LDA, which is <5A-convex for 
small molecules, will have an apparent linearity in large 
or periodic systems. It is, however, a qualitatively incor- 
rect straight line, with the energy at the N+1 integer 
point dictated by the fractional charge error of the func- 
tional. We can distinguish this from the correct behav- 
ior of the exact functional, which has intrinsic linearity 
with correct integer points for all M, whereas r5./V-convex 
functionals are only linear in the limit M — > oo with in- 
correct integer points. This is the derealization error of 
<5iV-convex functionals. 

The situation is reversed for <5iV-concave functionals, 
where the energy is always lower when the electron re- 
mains on one monomer unit, even as M increases. In 
fact the E vs. N curve is the same for all M. Derealiza- 
tion actually raises the energy, as the initial slope points 



3 



0.40 




^ 0.02 - 



0.00 







1 M = 1 






M = 2 


^ 




II M = 3 






a) HF 



Unit 1 



Unit 2 



0.02 



z 0.00 



Unit 3 




b) LDA 



Figure 3: Energy for fractional numbers of electrons for 



Figure 4: Density difference plot for (Hie)M system with HF 
on top and LDA bottom. 



to above the integer points such that the inequality in 
Eq. ([9]) is reversed. For <5iV-concave functionals we will 
find A s traight 7^ if we carry out an energy minimized 
calculation at N + 1 in an infinite system. This is the 
localization error in (5-ZV-concave functionals. However, if 
periodic symmetry is imposed in the calculation, then the 
additional electron is dclocalized through the entire crys- 
tal as required by the translational symmetry, a straight 
line will be seen that follows the initial slope of the E 
vs. N curve. This delocalized state also has the energy 
of Eq. |10[ which is a much higher energy, imposed by 
the symmetry. All the above arguments apply both to 
the addition of an electron and the addition of a hole 
(removal of electron). 

In a periodic system, we see the maximum effects of the 
localization and derealization error: for both <W-convex 
and (W-concave functionals, we will have the apparent 
linearity for the fractional charge, with the straight lines 
following the initial derivatives and leading to too low 
band-gap for (JiV-convex functionals and and too high 
band-gap for <5iV-concave functionals. This explains the 
errors in the band-gap prediction. 

In a finite system, delocalization error increases with 
system size until the apparent linearity appears. But lo- 
calization error stabilizes at certain system size. This 
also offers guidance on calculations of band-gap for fi- 
nite systems: The approach to calculate the band-gap by 
explicit calculation of / and A from subtraction and addi- 
tion of electron to finite neutral species, which works well 
with S TV-convex functionals for small molecules [3], will 
not work for larger molecules, because localization error 
increases leading to the incorrect nature of the N — 1 
and N + 1 points. However it may work for <57V-concave 
functionals, which do not suffer from the apparent linear- 
ity problem (without translational symmetry) and may 
give meaningful integer points. This issue is also slightly 



clouded by the fact that HF theory may not give a rea- 
sonable energy for the localized electron or even the right 
amount of localization. Hence it will give an additional 
error to the integer points, but this has a a different phys- 
ical basis. 

The discussion up till now has focused on the energy 
differences and derivatives associated with the band-gap 
as it shows very clearly the basic physical biases of ap- 
proximate functionals. However, these biases of the func- 
tionals have much wider implications. We can see the 
differing behavior of the two types of functionals: 5N- 
convex (or LDA-type) functionals tend to delocalize elec- 
trons and SN-conc&ve (or HF-type) functionals tend to 
localize electrons. So the nature of the electron density 
distribution is dictated by the functional rather than the 
underlying physics of the material. These are the delocal- 
ization and localization error of approximate function- 
als. An intrinsically linear functional does not suffer from 
these errors. The delocalization or localization error of 
approximate functionals arc responsible for much of the 
deviation of calculated DFT properties from experimen- 
tal results. 

The idea of delocalization error introduced here is re- 
lated to many-electron self-interaction error (SIE) [8lll0j. 
SIE has been blamed for a poor description of the band- 
gap, but without an understanding of the actual errors 
that it may introduce in to a particular calculation. We 
believe that the terms localization and delocalization er- 
ror capture the physics of the problem in a more useful 
manner than self-interaction error. 

The argument above is carried out in the infinite lat- 
tice constant limit but it is clear that same physical bi- 
ases will be found at finite lattice constant in a normal 
periodic calculation. To illustrate the delocalization and 
localization errors we carry out a simple calculation on 
a one-dimensional system based on previous work |15j of 
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H2 polymer polarizability. We take a set of H2 molecules 
that clearly shows the characteristic behavior of Fig. 1, a 
chain made up of 16 atoms, and repeat it with a 15 a.u. 
distance in between the units. The results in Fig. 3 have 
the same behavior as in Fig. 2, showing that the energy 
of a <5-/V-concavc functional (HF) remains the same, in- 
dependent of the number of units, M. With LDA we see 
the convex behavior disappear as the derealization er- 
ror increase with M, and the E(N) curve becomes linear 
following the initial slope of the monomer unit. We can 
see that the point at the integer corresponding to the ad- 
dition or subtraction is qualitatively wrong with a much 
too low energy. Even changing the distance between the 
units from 15 a.u. to 5 a.u. has no effect on Fig. 3. 

Also in Fig. 4 we show a plot of the difference den- 
sity (p(N + 1) — p(N)) for different sized units. We ob- 
serve a clear difference between HF and LDA. HF local- 
izes the extra electron to just one of the units, whereas 
LDA delocalizes the extra electron over all the units with 
a corresponding drop in energy. This clearly shows the 
delocalizing bias of LDA and the systematic error it can 
cause. 

All these ideas tie in with the understanding of the 
band-gap originally from Kohn |16| . which relates the 
band-gap to localization [17]. A systematic error in the 
band-gap implies a systematic error in describing local- 
ization, which is just what we find. There will also be a 
systematic qualitative error in the nature of the HOMO 
and LUMO orbitals and their corresponding eigenvalues 
for large molecules, as well as the conduction and valence 
bands for a crystal. These issues have widespread rele- 
vance in the calculation of many electronic properties of 
solids and large systems, as the derealization error in 
5iV-convex functionals like LDA affects large molecules 
and solids much more than small molecules. 



The understanding given here also explains why 
TDLDA can be more successful for the calculation of 
small molecules and metals than for non-metallic infinite 
solids and polymers [2], where there is a basic problem 
in the description of the response of the density due to 
the derealization error. It can also explain why Hartree- 
Fock and similar methods have problems with metallic 
systems due to the fact the functional localizes electrons 
and therefore opens a gap when the true nature should 
be to be delocalized with no gap at the Fermi-level. 

To conclude, we have shown that the errors in the en- 
ergy for fractional charges in finite systems leads to sys- 
tematic errors at the integer points of larger systems. 
The addition of electrons or holes is poorly described by 
<57V-convex functionals as they delocalize the added par- 
ticle. This leads to errors in the initial slope as is seen 
by a band-gap calculation, but also means that the ex- 
plicit calculation of / and A, for example in large cluster 
calculations, will suffer from the same error. Functionals 
which have opposite <5iV-concave behavior have the op- 
posite tendency to localize electrons. This means that 
although there are problems using the initial slope we 
can still gain information from the explicit finite system 
calculation of / and A. 

The understanding offered in this work explains the 
physical nature of the error in the band-gap from com- 
monly used approximate functionals, and shows the im- 
plications of this error to the calculation of many other 
properties of solids, from optics to electron transport. A 
path forward is shown: by constructing functionals free 
from localization or derealization error, one would be 
able to overcome most of the problems. 
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